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Abstract. Let G be a finite tree with root r and associate to the internal 
vertices of G a collection of transition probabilities for a simple nondegenerate 
Markov chain. Embedd G into a graph G' constructed by gluing finite linear 
chains of length at least 2 to the terminal vertices of G. Then G' admits 
distinguished boundary layers and the transition probabilities associated to 
the internal vertices of G can be augmented to define a simple nondegenerate 
Markov chain X on the vertices of G' . We show that the transition probabilities 
of X can be recovered from the joint distribution of first hitting time and first 
hitting place of X started at the root r for the distinguished boundary layers 
of G'. 



1. Introduction 

Computing networks consist of hardware devices (hosts, routers, end terminals, 
etc), together with a collection of connections between pairs of such devices, along 
which packets of information are passed. This rudimentary structure is readily 
modeled by a graph A = (V, E) where the vertex set V represents hardware devices 
and the edge set E C V x V represents direct connections between devices. If, in 
addition to the underlying graph structure, parameters are associated to vertices 
and edges, it is possible to produce a more accurate model of a given computing 
environment. When the parameters defining the model (including the underlying 
graph) are dynamic, network performance can be expected to vary, and network 
control and/or predictability become issues of serious consequence. For real world 
applications, the first step in addressing such issues involves the accurate monitoring 
of the parameters which define the network. 

For networks modeled as above, it is often the case that direct monitering of 
system parameters is impossible and one must rely on inference methods to produce 
reliable estimates for parameter values (cf |CCLWY] for a recent survey). The 
search for good estimates provides a rich source of challenging inverse problems 
(for related work see [Bl3F] . |LY] , |RCWj . |TYBW| and references therein). In this 
paper we formulate and solve one such problem. 

The problems in which we are interested involve a fixed network topology in 
which one designated device can send packets to a collection of endusers and monitor 
packet arrival at enduser positions, but cannot directly observe any behavior for 
devices between packet origin and packet collection. We are interested in using 
packet arrival times to determine network parameters associated to devices which 
are not directly observable. Thus, we are interested in a type of network tomography 
problem. To concisely state our results, we begin by formalizing the discussion. 



Date: February 2, 2008. file name: trees2.tex. 

2000 Mathematics Subject Classification. Primary: 60J10, 90B10. 

1 



2 VICTOR DE LA PENA, HENRYK GZYL, AND PATRICK MCDONALD 

Let A = (V, E) be a finite tree with root vertex r, terminal vertices Vterm(A) C V, 
and internal vertices V \ Vtorm(A) (see section 2 for background and notation). At 
each terminal vertex of A glue on a finite linear tree with vertex set of size at 
least 2 (the size of the linear chain is determined by the geometry of A and the 
terminal vertex in question: see section 2). Call the resulting graph, denoted A', 
an augmentation of A and note that A is naturally embedded in A'. Note that since 
each terminal vertex of A has in effect been replaced by a linear segment of length 
at least 2, it is possible to identify "two layers of boundary in A'." More precisely, 
denote the outer boundary layer of A' by V ou t(A') = Vtcrm(A') and denote the 
inner boundary layer of A by Vi n (A') = {v* 6 V(A') : v*v is an edge}. 

To each internal vertex of A associate the transition probabilities of a simple 
nondegenerate Markov chain. Thus, for each internal vertex v* there corresponds 
a collection {t v * v } of positive probabilities which sum to 1 as v varies over vertices 
for which v*v is an edge. To every vertex of A' which is not an internal vertex of A 
or a terminal vertex of A', associate the transition probabilities of the simple sym- 
metric random walk (by construction, for every such vertex there are precisely two 
adjacent vertices). The transition probabilities associated to the internal vertices 
of A together with the transition probabilities associated to the vertices of A' which 
are not internal vertices of A suffice to define a simple Markov chain on A' (killed 
upon reaching the outer boundary of A'). We denote this Markov chain by X and 
refer to it as the augmented chain associated to A'. We ask: 

What can we learn about the transition probabilities associated to 
the internal vertices of the network A by monitoring the arrival 
times of the Markov chain X, started at the root of A, at detectors 
placed in the boundary layers? 

Our main result is that there is an augmentation for which we can recover ev- 
erything. Postponing technical definitions to section 2, we have 

Theorem 1.1. Let A = (V, E) be a finite tree with root r and unkown transition 
probabilities associated to its internal vertices. Let A' be the 2-spherical augmen- 
tation of A and suppose that X is the augmented chain associated to A'. Let P[ n 
be the joint distribution of the first hitting time and the first hitting place of X 
started at r for vertices in the inner boundary layer Vj n (A') and let P£ ut be the 
joint distribution of the first hitting time and the first hitting place of X started at 
r for vertices in the outer boundary layer V ou t(A'). Then P[ n and P£ ut completely 
determine the transition probabilities of X. 

Our proof of Theorem ll.ll cstablishcs somewhat more: we show that the unkown 
transition probabilities are rational functions of special values of the joint distri- 
butions PJ* n and Po Ut with explicit bounds on the time variable given in terms of 
the geometry of the graph of A (see Corollary 13.8(1 . As a result, the natural em- 
pirical statistics are consistent estimators for the unkown transition probabilities. 
Statistical extensions and refinements of these results will appear elsewhere. 

The proof of Theorem 11.11 (see also Theorem 12 .4|) relies on a close examina- 
tion of the structure of the path space associated to the process X and recursion. 
The argument generalizes that given for chains in [DGMlj : it depends on the tree 
structure of A. 

While we have chosen to present our results in the context of computing, it is 
clear that Thcorcm ll . ll should have applications in a variety of applied environments 
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(our interests were originally directed towards inverse problems for one-dimensional 
diffusions). Indeed, there is a variety of related literature (for applications in medi- 
cal imaging, see the survey pQ; for an application involving ncuroscience, see |BC| ). 
A number of such applications have been discussed by Grunbaum and his collabora- 
tors (cf |Grl| . |Gr2| . |GMj |P] and references therein). Our results involve different 
techniques and focus on detailed "time of flight" information, distinguishing it from 
the work cited above. 

2. Background and Notation 

Let A = (V,E) be a finite rooted tree. Thus, A is a connected graph without 
cycles, with finite vertex set V and edge set E C V x V, and a distinguished element 
r G V. We will say that a vertex v is terminal if there is exactly one vertex u such 
that uv G E, We will write Vterm(A) for the set of terminal vertices. We refer to 
vertices which are not terminal as internal vertices. 

By a path in A we will mean an ordered tuple of vertices, (y\, z>2, ■ ■ ■ , v n ) where 
ViVi + i G E for all i < n. Given a path 7 = (vi,V2, ■■■ ,V n ) we will say that 7 
connects v\ to v n . We write V uv for the collection of paths connecting u and v. 

Associated to every path 7 is a length: the length of 7, denoted by £(7), is the 
number of edges defined by 7 (i.e. if 7 = (v\, v%, . . . , v n ), then l(jy) = n — 1). There 
is a natural notion of distance between vertices of A : 

dist(it, v) = min {£(7)}. 

The length function and the root give rise to a norm: 

\v I = dist(w, r). 

The norm gives rise to a partition of the vertices of A by shells: 

(2.1) V k (A) = {vGV(A):\v\ = k}. 

Because A is a tree, if v G Vfc+i, there is a unique vertex v* G Vk such that v*v is 
an edge. 

A simple but important example is given by a discrete interval: given integers 
— k < < I, the (— k, Z)-segment is the rooted tree with k+l + 1 vertices obtained by 
taking as vertices the integers {— k, —k+1, . . .,1}, and edges given by i(i + l), — k < 
i < I, and root vertex (when k = we will refer to the corresponding segment as 
the Z-segment). For this example, the shells of A contain either one or two vertices. 

If A is a finite tree with root r, we can associate to A an outer radius and an 
inner radius: 

(2.2) Rout (A) = max 1 , e y (A) {|u|} 

(2.3) R in (A) = min {\v\}. 

i>ev torm (A) 

We will say that A is spherical if R ou t(A) = Ri n (A). Note that for spherical rooted 
trees we have 

^Rout(A) = Vtcrm(A). 

Definition 2.1. Suppose that A is a rooted tree, v G Vteriu(A), and I G N. The 
Z-augmcntation of A at v is the finite rooted tree obtained by gluing a copy of the I 
segment to A by identifying the root of the l-segment with the terminal vertex v and 
taking the root of the resulting tree to be the root of A. We say that the rooted tree 
A' is an augmentation of A if A' is obtained from A by a series of augmentations at 
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Figure 1. A rooted tree and a 2-complctc augmentation. 

boundary vertices. We say that A' is an m-complete augmentation of A if A' is an 
augmentation of A which can be obtained by first performing an m- augmentation 
of A at each terminal vertex of A. 

Thus, if we /-augment the /-interval at S Vt er m([0, /]) we obtain the (—/,/)- 
interval. Similarly, given n copies of the /-interval, we can glue them together at 
and take as root the gluing point to obtain a spherical rooted tree of radius / which 
we will refer to as the (/,n)-star. 

Given a rooted tree A we can always construct an augmentation of A which is 
spherical: 

Definition 2.2. Suppose that A is a rooted tree and that I is any natural number. 
For each v S V tC rm(A), perform an (R out (A) — \v\ + 1) -augmentation of A at v. The 
resulting augmentation is called the l-spherical augmentation of A. 

Thus, if A is a finite rooted tree and A' is the /-spherical augmentation of A, 
then A' is spherical and 

R in (A')=Rout(A / )=Rout(A) + /. 

Given a finite rooted tree A and an /-spherical augmentation A', suppose that 
A is a nondegcncratc simple Markov chain on A'. We arc interested in determining 
the structure of A on A via first passage probabilities at the boundary of A'. More 
precisely, 

Definition 2.3. Let A be a finite tree with root r and A' an l-spherical augmentation 
of A. Let X be a nondegenerate simple Markov chain on A'. We say that X is 
determined by /-spherical first hitting times if the transition probabilities for vertices 
in A are completely determined by the triple (W, P£ ut ,Pj" n ) where 

• W is the collection of transition probabilities for vertices V(A') \ V(A), 

• -^out * s ^ e joint distribution of hitting time and hitting place of X started 
at the root for vertices in the shell Vr^^a'), an & 

• P[* n the joint distribution of hitting time and hitting place of X started at 
the root for vertices in the shell VR out (A')-i- 

We can now concisely state our main theorem: 

Theorem 2.4. Let A be a finite rooted tree and suppose that X is a nondegenerate 
simple Markov chain on the 2-spherical augmentation of A. Then X is determined 
by 2-spherical first hitting times. 
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Before proceeding to the proof of Theorem 12.41 we note that the main result of 
|DGM1| establishes an important special case: 

Theorem 2.5. DGMl] Let k and I be natural numbers and suppose that X is a 
simple nondegenerate Markov chain on the 2-spherical augmentation of the (—k,l)- 
interval. Then X is determined by 2-spherical first hitting times. 

Thus, as noted in [DGMlj . there arc simple counterexamples to the most straight- 
forward generalizations of Theorem 12.41 fin particular, it is, in general, impossible 
to determine transition probabilities with a single pair of symmetrically placed 
detectors, i.e. with a single boundary layer). 

The proof of Theorem 12.41 involves an extension of the ideas developed for the 
proof of Theorem 12.51 As an important illustrative example of how the argument 
proceeds, we fix a natural number m and study the special case of the (1, m)-star. 

Enumerate the vertices of (1, m)-star A as w ith vo = 0. Using the norm 

to partition the vertices by shells (cf l|2.1|l '). we write 

V% = {v m+ j}JL 1 where there is an edge between Vj and v m+ j 

V3 = {v2m+j} 1 j l =i where there is an edge between v m +j and v-2 m +j- 

Let ri n be the first hitting time of Vi 

= inf{n > : X n G V 2 } 

and similarly, let r ou t be the first hitting time of V3. We will write the joint distri- 
bution of first hitting time and first hitting place as in Definition 12.31 

P° n (fc,j) = P°(r in = fc,A Tm =t; m+J ) 

F° ut (M = P°(r out = fc,A Tout ,=v 2m+j ). 

We write tjj for the probability of transitioning from vertex Vj to vertex vi in one 
time step. Then 
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from which it follows that the transition probabilities ij,m+j 
all j. From (|2.4() . it follows that the transition probabilities toj 
all j. Since the walk is by assumption simple, the transition probabilities tj t o are 
determined for all j. We conclude: 
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Lemma 2.6. For every m, every nondegenerate simple Markov chain on the (l,m) 
star is determined by 2-spherical first hitting times. 
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3. Proof of Theorem 12.41 

To establish the general case, we begin with an observation: Every rooted tree 
naturally embedds in its spherical augmentations. Thus, 

Lemma 3.1. Theorem \2.4\ is true for general rooted trees if and only if it is true 
for all spherical rooted trees. 

Let A be a spherical rooted tree. To prove Theorem l2.4l we give a careful analysis 
of the structure of paths beginning at the root and having certain prescribed hitting 
properties for the outer shells of A' where A' is a (general) spherical augmentation of 
A. We first demonstrate that we can recursively determine transition probabilities 
associated to terminal vertices of A. Using this result and the methods employed to 
obtain it, we establish a recursion algorithm for determining all unknown transition 
probabilities. 

To this end, let R > be the radius of the spherical rooted tree A. Let m > and 
let A' be the (m + l)-spherical augmentation of A. We refer to elements of Vr+„j+i 
(respectively, Vn+ m as outer boundary vertices (respectively, inner boundary ver- 
tices). Fix a vertex v G Vr+th+i & n d define (for the remainder of the paper) 

(3.1) T = (R + m + l) + 2m. 

We consider paths beginning at the root and having T as the first hitting time for 
the vertex v G Vs+m+i. More precisely, we define 

I\, = {7 : 7(0) = r, j(T) = v, 

(3.2) 7 (i) ? v for all j < T}. 

Elements of T v do not visit most boundary vertices of A' : 

Lemma 3.2. Let v G Vn+m+i an d suppose v* G Vn+ m is the unique vertex such 
that v*v is an edge. For T v as in \3.ty) . if j G T v , then Vr +to \ {v*} for all 

3<T. 

Proof Let 7 be a curve in T v and suppose |7(j')| = R + m, ^ v*. Then 
j > R + m — 1. Denote by r the first time that 7 visits v. Then 

t > j + (m + 1) + (m + 2) 
> R + m-l + 3 + 2m. 

We conclude that r > T, which completes the proof of the lemma. 
We partition r„ by first hitting times of v* : 

Lemma 3.3. Let v G Vn+m+i be an element of the outer boundary layer of A' and 
let T v be as in 13.2(1 . Suppose that v* is the unique vertex for which v*v is an edge 
and define 

Tv,l = {"/eT v :j(T~(2l-l)) = v*, 

(3.3) | 7 (j)| <R + m for all j < T - (21 - 1)}. 

Then 

(1) r^nr^ = if%^ 3 

(2) u^t 1 ^,, = r„. 
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PROOF If i ^ j, elements of T v< i and T Vt j have different first hitting times of v* 
and thus T Vl i R T v j = 0. Since every element of T v begins at the root and hits v* 
by time T, U^j 1 ^ = r„. 

Initial segments of paths in define paths with nice first hitting properties. 
We make this precise: 

Lemma 3.4. Let 1 < I < m + 1. For 7 G r v> ;, £/ie pai/i ^(7) obtained by truncating 
7 at time T — (21 — 1) satisfies 

(1) C,( 7 )(0)=r 

(a; c,(7)(r-(2i-i)) = v * 

W |C,(7)0')I < R + m f or a tt 3 < T - (21 - 1). 

PROOF The first statement is obvious. By definition, for 7 G T v j, the first hitting 
time of v* is T — (21 — 1). From this and Lemma Rj. 21 we conclude that (2) and (3) 
hold. 

Truncation provides for a decomposition of paths in T v j : Each such path consists 
of an initial segment which has nice first hitting properties, followed by an end 
segment which never visits the tree A. We make this precise: Denoting starting 
positions by a superscript, we write 

(3.4) V(t,v) = Probability({starting at r, X first hits v at time t}). 
We have: 

Lemma 3.5. Let T v j be as defined in lemma WJ^ For 1 < I < m + 1, 
(3-5) P r (r t u) = Pl(T-(2l-l),v*)Xv,i 

where Xv,l is an expression which involves only the transition probabilities for ver- 
tices z with R + 1 < \z\ < R + m + 1. 

PROOF By Lemma l3~4l each 7 G T v j can be decomposed as a path ^(7) starting 
at the root r with first hitting time of {v*} occurring at time T — (21 — 1), followed 
by a path of length (21 — 1) which begins at v* and ends when it makes its first 
visit to v. We will write 

f„,, = {j:j(0)=v*,j(2l-l)=v, 
(3.6) \j(j)\ <R + m + l for all j < 21 - 1}. 

By choice of /, if 7 G T v j, \j(j)\ > R for all < j < 21 - 1. Thus, if 7 G f^,; we can 
compute P" ({7}) in terms of the transition probabilities associated to vertices z 
with R < \z\ < R + m. Summing over all elements T v ; gives an expression 

Xv,l = P v '(T v ,i) 

which involves only the transition probabilities for vertices z with R < \z\ < R + m. 
Finally, using Lcmma r3.4l we compute ¥ r (T v i) : 

¥ r (T v j) = VZ a (T-{2l-l),v*) X v,i 

as required. 

The next result establishes that the transition probabilities at the terminal ver- 
tices of A are m-spherically determined by first hitting times. It is also the first 
step in an inductive proof of Theorem 12.41 
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Lemma 3.6. Let m > 1. Let A be a spherical tree with root r and radius R, A' 
the (m + l)-spherical augmentation of A. Let u G Vr, and suppose w is the unique 
vertex of A' for which uw is an edge of A'. Then the transition probability t uw is 
determined by the triple (W, FoutJ where W is the set of transition probabilities 
for vertices V(A') \ V(A), Po Ut is the joint distribution of first hitting time and first 
hitting place for Vr+ to +i, and P[" n is the joint distribution of first hitting time and 
first hitting place for Vr+ to . 

Proof Let v be a terminal vertex of A' a distance m + 1 from u. Let T be as in 
(13. P and let v* be the unique vertex such that v*v is an edge of A'. From Lemma 
13.31 and Lemma 13.51 we have 

P r (T,v) = P r (F) 

m 

(3.7) = ^P[ n (T-(2?-l),^) X ^+P r (r t ,, m+1 ). 

2 = 1 

We let 7* be the element of r^ jTO+ i which "changes direction exactly twice." From 
(|3.1|) and (|3.3(l . 7* is the path which starts at r, moves out radially R + m units, 
moves in radially m units and moves out radially m + 1 units. Since wc know 
all transitions associated to 7* we can explicitly compute the probability that 7, 
occurs: 

(3.8) P r ({7*}) = X*t uw 
where 

(3.9) X * = Ku,(R + m + l,v)p uv 

and p uv involves only transition probabilities along the path of length m + 1 from u 
to v (if we write the unique such path as uqUi . . . u m +i with uq = u and u m+ i = v, 

then Puv = (nr=i li « I+ i« I )(n l =o 1 ^«.+i))- 

Recall, an element of T v _ m+ \ starts at position r, first hits position v at time 
R + m+ 1 + 2m, and first hits position v* at time R + m. Thus, if 7 £ r^ jtTl+ i \ {7*}, 
then, as in Lemma |3.5I we may view 7 as a truncation followed by a path which 
never visits u. Thus, as in Lemma 13.51 we can write 

(3.10) P r (r^, m+ i \ {7*}) = n n (R + m,v*)xv, m+ i 

where Xv,m+i depends only on transition probabilities for vertices z such that R < 
\z\ < R + m. Using l|3.7|l . (|3.8|l and (|3.10() we can solve for t uw : 



(3.11) t uw — 

X* 



t(T,v) 



L 1=1 



This complete the proof of the lemma. 

The next result provides for the inductive step in the proof of Theorem 12 .41 

Lemma 3.7. Let A be a rooted tree, A' the 2-spherical augmentation of A. Suppose 
that X is a simple nondegenerate Markov chain on A', and that the transition 
probabilities for the vertices V^A') \ (U*L ^j) are known. Let 116I4 and w G Vk+i 
be such that uw is an edge. Then the transition probability t uw is determined by the 
transition probabilities at the vertices V(A') \ (U^L Vj) and the joint distributions 
of first hitting time and place, P[ n and V r ovit . 
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PROOF Let Vterm(w, A') be the terminal vertices of A' which can be connected 
to w by a path of length R + 2 — (k + 1). Let 
(3.12) 

V* erm (iu, A') = {v* G Vr+i : there exists v G V te rm(w, A') with v*v an edge}. 



Set 

(3.13) T u 
and let 

r 

(3.14) 

As in Lemma EOl if 7 £ T uw , then j(j) Vr+i \ V* erm (u>, A') for all j < T w . For 
1< I < k + 1, set 



i? + 1 + (R + 1 - k) + (R + 2 - k) = 3R + 4 - 2k 

{7 : 7 (0) = r, 7 (r„) £ V tcrm K A'), 

7(j) g Vterm(tf) A') for all j < T^}. 



{7 G T U10 : 7 (T t0 - (2/ - 1)) G V* erm (™, A'), 

| 7 (j)| <i?+l for all j<T tt 



(21-1)}. 



Then, as in Lemma 13.31 the sets T uw j partition T uw . Moreover, as in Lemma 13.41 
paths behave nicely under truncation in that for all / with 1 < I < k + 1, paths in 
T UWi i have truncations which start at the root r and first hit Vr+i in V* erm (u;, A') 
at time T w — (21 — 1). As in the case k = R, if 1 < I < k + 1, a path 7 G T UW: i 
can be decomposed as a path £^(7) which starts at the root r and first hits Vr+i in 
Vt erm (ui, A') at time T w — (21 — 1), followed by a path that never visits the k shell 
Vfc(A). As in Lemma f3. 51 we conclude 

(3.15) P r (r„ w ) = 



E 

t, *£ V teim(« 



^(T w -(2l-l),v*) X v,l 



where \v.i is an expression which involves only the transition probabilities for ver- 
tices z with k + 1 < \z\ < R + 2. As in Lemma |3.6I the paths T UW: k+i contain a 
distinguished subset of elements: those with an initial segment which moves to a 
radial distance of R+ 1 in time R+l, followed by a segment that moves in a radial 
distance of k units in k time units, followed by a segment which moves a radial 
distance of k + 1 units (see (|3.13|) ). If we denote this subset by T*^, then, as in 
Lemma 13.61 we have 



(3.16) 



E 



l (R + 2,v)p u 



UGV t erm(>,A') 



where p,™ involves only transition probabilities along the path from w to v (and 
these transition probabilities are by assumption known). Finally, if 7 G T UWt k+i \ 
r* TO , then j(R+ 1) G V* crm (-u;, A') and 7(i? + 1 + 2k) G V tC rm(w, A') which implies 
that 7 does not visit the k shell Vc(A) once it has left it. We conclude 



(3.17) 



p r (r 



uw,k-\-l 



\T* ) = 

\ UW ) 



E 

u*ev t * erm (io,A') 



where x^™* involves only transition probabilities for vertices z satisfying k < \z\ < 
R+l. Using (|3.15|) . (|3.16|) . and 13.17f) . we can, as in Lemma 13*1)1 solve for t uw . This 
concludes the proof of the lemma. 
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Proof of Theorem 12.41 The proof is recursive; an induction on distance to 
the inner boundary of the 2-spherical augmentation. The formal argument is as 
follows: 

By Lemma 12.61 it suffice to consider the case of spherical trees A of radius R 
where R > is arbitrary. Let A' be the 2-spherical augmentation of A and for 
u G V(A), let d = d(u) be the distance of u from the inner boundary. Vr+i(A'), of 
A'. If d = 1, then by Lemma f3. 61 t uw is determined by Pf n and P£ ut . If the result 
holds when d = k — 1 , by Lemma 1X71 it is true when d = k. This finishes the proof. 

From the proofs of Lemma l3.6l and Lcmma l3.7l we note that, given a finite rooted 
tree, A, embedded in its 2-sphcrical augmentation A' and a simple nondegenerate 
Markov chain, we only require a finite number of values of the joint distribution of 
exit time and place to determine the transition probabilities for a simple nondegen- 
erate Markov chain on the embedded tree. More precisely, we have: 

Corollary 3.8. Let A be a rooted tree with outer radius R out (A). Let A' be the 2- 

spherical augmentation of A and suppose that X is a simple nondegenerate Markov 
chain of A'. Then there is an algorithmic procedure for explicitly determining the 
transition probabilities of X on A from the 2-spherical hitting times. The algorithm 
depends on data from the joint distribution of exit time and place for time t < 3i?+4. 

Proof From the proof of Lemma 13.71 to determine transition probabilities for 
elements of the k shell Vfc(A) we need to sample times up to 3R + 4 — 2k (cf 13.13| l). 
The corollary follows immediately. 
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